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Abstract 

In their paper on Wilf-equivalence for singleton classes, Backelin, West, 
and Xin introduced a transformation (f>* , defined by an iterative process 
and operating on (all) full rook placements on Ferrers boards. Bousquet- 
Melou and Steingnmsson proved the analogue of the main result of Back- 
elin, West, and Xin in the context of involutions, and in so doing they 
needed to prove that <j>* commutes with the operation of taking inverses. 
The proof of this commutation result was long and difficult, and Bousquet- 
Melou and Steingnmsson asked if (f>* might be reformulated in such a way 
as to make this result obvious. In the present paper we provide such a re- 
formulation of 4>* , by modifying the growth diagram algorithm of Fomin. 
This also answers a question of Krattenthaler, who noted that a bijection 
defined by the unmodified Fomin algorithm obviously commutes with in- 
verses, and asked what the connection is between this bijection and (j>* . 

1. Introduction 



For any permutation r = T\Ti . . . r r , let S n (r) denote the set of permutations 
in S n that avoid r, in the sense that they have no subsequence order-isomorphic 
to r. 

In their paper Wilf-equivalence for singleton classes [1], Backelin, West, and 
Xin prove an important general result about permutations avoiding a single 
pattern: If k, £ > 1 and p is a permutation of {k + 1, . . . , k + £}, then for every 
n > k + £ we have |S I „(12 . . . kp)\ = \S n (k . . . lp)\. The key tool in the proof is a 
map <p* , which operates on a permutation a as follows: Order the k . . . 1-patterns 
(Tij . . . (Ti fc in a lexicographically (according to the Oj's, not the j's) and let <j)(cr) 
be obtained from a by taking the smallest . . . Oi k and placing in positions 
i\, . . . , ife the values at 2 , . . . , Ui k , , respectively, and leaving all other entries of 
a fixed. Let 4>* (a) be obtained by applying <f> repeatedly until no k . . . 1-patterns 
remain. It is shown that <fi* induces a bijection from S n (k — 1 . . . lfc) onto 
S n (k ... 1), and that from this bijection one can obtain an important ingredient 
of the proof, namely a bijection from S n (l . . .k) onto S n (k . . . 1). 

In [3] , Bousquet-Melou and Steingnmsson prove the analogue of the Backclin- 
West-Xin Theorem in the context of involutions, and in so doing they must 
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prove that 0*(cr _1 ) = (0*(<r)) _1 for all permutations cr, so that the bijection 
from S n (l . . . k) onto S n (k ... 1) will also commute with inverses. The proof of 
the commutation result for 0* is long and difficult, and Bousquet-Melou and 
Steingn'msson ask for a reformulation of <f>* that will make this result obvious. In 
[6], Krattenthaler describes another bijection from S n (l . . . k) into S n (k ... 1), 
in terms of growth diagrams, and notes that this bijection clearly commutes 
with inverses. He asks what connection there is between this bijection and cj>* . 
In the present paper we answer both questions, by providing a reformulation of 
(jf in terms of growth diagrams. 

In proving their theorem, Backelin, West, and Xin find it necessary to work 
in the context of full rook placements on Ferrers boards, which includes permu- 
tations as a special case. For any Ferrers board F and any permutation r, let 
Sf{t) denote the set of all full rook placements on F that avoid r. (The relevant 
definitions will be reviewed in Section 2.) 

Backelin, West, and Xin prove that . . . kp)\ = \Sp(k . . . lp)|, for all F 

and all permutations p of {k+l, . . . , k+£}, and in so doing they use an extension 
of <j>* to full rook placements. Bousquet-Melou and Steingn'msson also use this 
extension, so they prove that <p* commutes with inverses in this broader context. 
Accordingly, our reformulation of <j>* will be given in this context, or rather in 
the even broader context of arbitrary rook placements (not necessarily full), 
with the term "inverse" interpreted appropriately. 

The outline of our paper is as follows. In Section 2 we review the needed 
background material on the Robinson-Schensted correspondence for partial per- 
mutations, Ferrers boards and rook placements, and growth diagrams. In Sec- 
tion 3 we give our reformulation of cf>* and the proof that it works, modulo a 
"Main Lemma" . In Section 4 we introduce the tool that will be used to prove 
this lemma: the "pivots" of a rook placement on a rectangular Ferrers board. 
The pivots are related to the "L-corners" of [2], and are a generalization of 
the "rcL-corners" of [8] . (We have chosen to use the term "pivots" , instead of 
"corners" , because of the prior use of the term "corners" in connection with the 
diagram of a permutation.) Section 5 contains the proof of the Main Lemma, 
and the concluding Section 6 indicates how the proof leads naturally to a notion 
of generalized Knuth transformations. 

2. Review of the Needed Background 

2.1. The Robinson-Schensted correspondence for partial permutations 

A partial permutation tt is a bijection between two sets / and J of positive 
integers. We represent tt in two- line notation as 



7T = 




3m 



in 



where i\ < . . . < 



i m and the jVs are distinct . 
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The Robinson-Schcnsted insertion and recording tableaux P and Q for ir are 
obtained as follows. Start by placing j\ in the top row of P and i\ in the top row 
of Q. Assuming inductively that i\, . . . , it-i and ji, . . . ,jt—i have been placed, 
place jt in P as follows. If j t is larger than all elements already in the top row of 
P, place jt at the right end of this row. If j s is the leftmost element already in 
the top row that is larger than j t , replace j s by j t and "bump" j s to the second 
row. Place j s at the right end of this row unless it is smaller than some element 
in this row, in which case let j s bump the leftmost clement larger than it to the 
third row, and continue in this way. Place it in the position in Q corresponding 
to the position in P that first became occupied when j t was placed in P. 

For example, if 

1 2 6 7 8 
v 4 5 3 1 2 

then 



P. 
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A basic property of P and Q is that there exists a partition A = {Ai > A2 > 
• ■ ■ > At} of m such that the top rows of P and Q each contain Ai entries, 
the second rows each contain A2 entries, and so on. The partition A is called 
the shape of P and Q. In motivating our reformulation of eff it will be helpful 
to recall the theorem of Schensted [9] that states that Ai is the length of the 
longest increasing subsequence in 7r, and t is the length of the longest decreasing 
subsequence. 

We will also use the theorem of Schiitzenberger [10] that states that the 
insertion and recording tableaux for the inverse bijection 7r _1 are Q and P, 
respectively. 



2.2. Ferrers boards, rook placements, and (jf 



Consider annxn array of squares, and identify the pair with the square 
located in the ith column from the left and the jth row from the bottom. For 
any square (i,j) in the array, let R(i,j) denote the rectangle consisting of all 
squares (k, £) such that k < i and I < j. A Ferrers board (in French notation) is 
any subset F of such an array with the property that for all (i,j) G F we have 
R{i,j) Q F- So for some t and some Ai > . . . > A t , the Ferrers board consists 
of the first Xj squares from the jth row of the array, 1 < j < t. The conjugate 
of F is the Ferrers board F' = {{j, i) : (i,j) € F}, so that F' is obtained by 
reflecting F across the SW-NE diagonal. 

A rook placement on a Ferrers board F is a subset of F that contains at most 
one square from each row of F and at most one square from each column of F . 
We indicate the squares in the placement by putting markers (e.g., dots or X's) 
in them. A rook placement is called full if it includes exactly one square from 
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each row and column of F. (So if there exists a full rook placement on F, then 
F has the same number of columns as rows.) From any rook placement P on F 
there results a partial permutation tt such that square is in P if and only 
if j is the value of the bijection ir at input i. P is a full placement if and only if 
F has n rows and n columns for some n and tt is a permutation of {1, . . . , n}. 
For any rook placement P on F, the inverse P' of P is the placement on the 
conjugate board F' obtained by reflecting F and all the markers for P across 
the SW-NE diagonal. The partial permutations resulting from P and P' are 
inverses of each other, if we regard them as bijections between sets. If they are 
permutations, they are inverses in the usual sense. 

We say that a rook placement P contains a permutation r S S r if and only 
if the resulting partial permutation n contains a subsequence 7Tj I . . . 7r, r order 
isomorphic to t such that there is a rectangular subboard of F that contains all 
the squares {ij,^.). In this case we refer to the sequence of squares (i^x,-.) as 
an occurrence of r in P. We say that P avoids r if P does not contain r. 

It is clear how to extend the definitions of <f> and cf>* to rook placements, 
by using only the occurrences of k ... 1 in P, in the sense of the preceding 
paragraph. 

2.3. Growth diagrams 

Our reformulation of (f>* will be accomplished by modifying Fomin's ([4, 5], 
see also [6]) construction of the growth diagram of a rook placement P on a 
Ferrers board F. 

Fomin's construction assigns partitions to the corners of all the squares in 
F, using the markers of P, in such a way that the partition assigned to any 
corner either equals the partition to its left or is obtained from it by adding 1 to 
one entry, and the partition assigned to any corner either equals the partition 
below it or is obtained from this partition by adding 1 to one entry. We start by 
assigning the empty partition to each corner on the left and bottom edges of 
F. We then assign partitions to the other corners inductively. Assuming that 
the northwest, southwest, and southeast corners of a square have been 

assigned partitions NW, SW, and SE, we assign to the northeast corner the 
partition NE determined by the following rules. 

1. If NW ^ SE then let NE = NW U SE, the partition whose ith entry 
is the maximum of the ith entries of NW and SE. (Here we regard the 
absence of an entry as the presence of an entry 0.) 

2. U SW ^ NW = SE then NW is obtained from SW by adding 1 to the 
ith entry of SW, for some i. We obtain NE from NW by adding 1 to the 
(i + l)th entry. 

3. If SW = NW = SE then we let NE = SW unless the square 
contains a marker, in which case we obtain NE from SW by adding 1 to 
the first entry. 
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Lemma 1. ([6], Theorem 5.2.4 or [11], Theorem 7.13.5). For any square 
the partition assigned to the northeast corner of is the shape of 

the Robinson-Schensted tableaux for the partial permutation resulting from the 
restriction of P to the rectangle R(i,j). 

Example. Consider the following (full) rook placement P on the indicated 
Ferrers board F. 



The growth diagram is (denoting each partition by juxtaposing its entries) 
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Note that the partial permutation obtained by restricting P to R(8, 5) is 



5 



( 



1 2 6 7 8 
4 5 3 1 2 



) 



and the partition assigned to the northeast corner of square (8, 5) is 221, which 
is, by the example given in subsection 2.1, the shape of the Robinson-Schensted 
tableaux for it. 

In general, if we are given F and the partitions in the growth diagram for P 
that occur along the right/up border of F (i.e., the border of F minus the hor- 
izontal bottom edge and the vertical left edge), we can inductively reconstruct 
the rest of the growth diagram and the placement P by using the following rules 
to assign a partition to the southwest corner of square (i, j), given the partitions 
assigned to its other three corners. 

A. If NW ^ SE then let SW = NW H SE, the partition whose ith entry is 
the minimum of the ith entries of NW and SE. 

B. If NW = NE = SE then let SW = NW. 

C. If NE ^ NW = SE and NE differs from NW in the ith entry for some 
i > 2, then let SW be obtained from NW by subtracting 1 from the 
(i — l)th entry of NW. If NE differs from NW in the first entry, then let 
SW = NW and, in this circumstance only, place a marker in square (i, j). 

Since the application of these rules recovers the growth diagram and the 
placement P, it follows that, in the growth diagram, square has a marker 
in it (i.e., is in P) if and only if NE NW = SE and NE differs from NW in 
the first entry. 

3. The Reformulation of 0* 

We now modify the growth diagram algorithm (GDA) of subsection 2.3 to 
get a new algorithm GDAk for any k > 2. GDAk retains rules (1) and (3) of 
GDA, but replaces rule (2) by the following variant. 

2fe. Apply rule (2) with the proviso that if rule (2) produces a NE with k 
(nonzero) entries then delete the last entry and increase the first entry by 1. 

The motivation for rule (2^) comes from the theorem of Schenstcd mentioned 
in subsection 2.1. Keeping the number of entries in a partition A less than k 
prevents decreasing subsequences of length k in partial permutations whose 
Robinsion-Schensted tableaux have shape A. 

Definitions. For any rook placement P on a Ferrers board F, let seq(P, F) 
(respectively, seqfe(P, F)) denote the sequence of partitions along the right/up 
border of F that results from the application of GDA (respectively, GDA}.) to 
P and F. 
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Main Theorem. Fix k > 2 in the definition of <jf . Then for any rook placement 
P on a Ferrers board P, 

seq fc (P,P) =seq(4»*(P),F). 



Corollary. For any rook placement P on a Ferrers board F, 

<£*(P') = (^(P))'. 

Proof. This is essentially clear from the fact that the algorithms GDA and 
GDAk commute with the operation of taking the inverse of a placement. 

In a bit more detail, seqA;(P',P') is the reverse of seqfc(P, P), so, by the 
Main Theorem, seq(^*(P'), F') is the reverse of seq(0*(P), P), and this reverse 
is seq((</>*(P))', P'). By rules (A), (B), and (C) for the inverse algorithm for 
GDA, we conclude that cf>*(P') = (</>*(P))'. □ 

We will now give an example, to illustrate the Main Theorem and indicate 
the structure of its proof. 

Example. Let P be the placement from the example in subsection 2.3, and fix 
k = 3 in the definition of </>* . Performing GDA3 on P yields 
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and performing GDA on <fi*(P) yields 
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The partitions along the right/up border of F are the same in both cases, so 
seq3(P, F)=seq(0* (P), F), although the partitions in the interiors of the dia- 
grams are not always the same. 

In this example, performing GDA% on 4>{P) yields 
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Notice that, while the results of performing GDA3 on P and on (f>(P) are not the 
same diagram, they do agree on the boundary of i?(7,4), the smallest rectangu- 
lar subboard of F that contains the 321-pattern on which <f> acted and extends 
to the left and bottom edges of F. Because of the definition of GDA 3 , this is 
enough to make the two diagrams agree everywhere outside the rectangle. The 
idea of the proof of the Main Theorem will be to show that performing GDA k 
on P and on 4>(P) yields the same partitions on the boundary of the smallest 
rectangular subboard of F that contains the k . . . 1-pattern on which <j) acted 
and extends to the left and bottom edges of F. 

Proof of the Main Theorem. We proceed by induction on the number of applica- 
tions of 4> required to compute 0*(P). If no applications are required, the result 
is obvious, since <ft*{P) = P and performing GDA)~ is the same as performing 
GDA. 

Now suppose that m applications of <f) are required to compute (f>* (P) . Since 
computing cf>* ((f>(P)) requires only m — 1 applications of <f>, we assume inductively 
that 

seq fc (<KP),F)=seq(W(P)),F), 

i.e., that 

seq k (4>(P),F)= S eq(cf>*(P),F). 

We want to show that seq fe (0(P), F) = seq fc (P, F). 

Let R = R(a, b) be the smallest rectangular subboard of F that contains the 
k . . . 1-pattern on which (f> acted to produce <f>(P) and extends to the left and 
bottom edges of F. Let P R and (j>(P) R De the restrictions of P and </>(P) to 
R(a, b). By the definition of GDA k , all we need to show is that 

seq k (cf>(P) R ,R)=seq k (P R ,R). 

To show this, we will use the following two lemmas, which will be proved at the 
end of this section. 

Lemma 2. The placement Pr on R contains no k . . . 1-pattern that begins in 
a row below the top row of R or ends in a column to the left of the rightmost 
column of R. 

Lemma 3. The placement <^(P)jj on R contains no k . . . 1-pattern. 
By Lemma |3l 

S eq k (<f>(P) R ,R)=seq(<f>(P) R ,R). 

By Lemma [2l scq fc (PR, R) = seq(P R , R) except possibly at the northeast corner 
of square (a, b). 

Notation. Let c ne , c nw , and c se denote the northeast, northwest, and southeast 
corners of square (a, b). 

To conclude the proof, it will suffice to prove the next lemma. 
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Main Lemma. We have seq(P R ,R) = seq((j>(P) R ,R) except possibly at c ne , 
the northeast corner of R. 

For once this lemma is established, we will have 

S eq k (4>(P) R ,R)=seq k (P R ,R) 

except possibly at c ne . To see that the two also agree at c ne , let, by the Main 
Lemma, A be the common value of seq(Pfj, R) and seq(0(P)_R, R) at c nw . Since 

seq k ((f>(P) R ,R)=seq( ( t>(P) R ,R), 

the value of seq fc (<fi(P) R , R) at c ne is obtained from A by adding 1 to the first 
entry. (This follows from the last statement in subsection 2.3 and the fact that 
(j){P) R has a marker in square (a, b).) To see that seq fc (PR, R) has the same value 
at c ne , let [i, v be the values of seq(P R , R) at c se , c ne . Since, in the placement 
P R on R, R(a — 1, b) and R(a, 6—1) contain no k . . . 1-patterns (by Lemma|5) 
but R(a, b) contains such a pattern, it must be that v has k entries and each of 
A, (i has k — 1. Therefore, by the definition of GDA k , the value of seq k (P R , R) 
at c ne is obtained by adding 1 to the first entry of A. 

The proof of the Main Theorem is now complete, except for the proofs of 
Lemmas and [3] and the Main Lemma. The proof of the Main Lemma will 
occupy Section 5. We now turn to the proofs of Lemmas [5] and [H 

Notation. For a square B = (i, j) in a Ferrers board F, we denote i and j by 
col(_B) and row(B), respectively. 

Proof of Lemma\M Let D = F>\F>2 ■ ■ ■ D k be the sequence of squares, from left 
to right, constituting the smallest occurrence of k ... 1 in P. Let S = S± S2 ■ ■ ■ S k 
be another occurrence of k ... 1 in P. By the minimality of D, wc cannot have 
row(Si) < row(Di), so S cannot begin in a row below the top row of R — R(a, b), 
and <Si = D\. Suppose for a contradiction that S ends in a column to the left 
of the rightmost column of R, so co\(Sk) < col(Z)fe). 

If row(Sfc) > TOw(Dk) then S2 ■ ■ ■ S k D k contradicts the minimality of D. 
Clearly row(5fc) 7^ row(-Dfc), because S k and D k are in different columns. So 
row(S fc ) < row(D fc ). Therefore S k ^ D k ^, so col(5 fc ) ? col(D fc _i). If col(S fc ) > 
col(Dfe_i) then D\ . . . D k -\S k contradicts the minimality of D, since row(S'fc) < 
row(D fc ) < row(D fc _i). So col(5 fc ) < col(D fc _i). 

Now, assuming inductively that col(St) < col(L>f_i) for some t > 3, we have 
col(iSt_i) < col(Dt_i). Wc will show by essentially the same argument as in 
the preceding paragraph that col(St_i) < col(D t _2)- First, if row(St_i) > 
row(_D t _i) then ^2 . . . St-\Dt-\ ■ ■ ■ D k contradicts the minimality of D. So 
row(5 t _i) < row(A-i). If col(S*_i) > col(A- 2 ) then D x . . . D t _ 2 S t -i . . . S k 
contradicts the minimality of D. Thus col(5t-i) < col(£)f_2). 

Wc conclude by induction that col(52) < col(Di) = col(Si), a contradiction. 

□ 
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Proof of Lemma Again let D be the smallest occurrence of fc ... 1 in P, 
and let D\ , . . . , D* k be the squares by which D\,...,D}. are replaced in (/>(P)#. 
Assume for a contradiction that 4>{P)r has a fc . . . 1-pattern, S, in P. Let c 
be the number of squares that D* = P>\ . . . D* k has in common with S. (Note 
that D\ is the square in the northeast corner of R ) Let d = k — c be the 
number of squares in S that are not in D* . Observe that c > 1. If this were 
not the case then S would contain no square D* and therefore it would also be 
a k . . . 1-pattern in Pr. Then row(Si) < row(D^) = row(Z?i) would contradict 
the minimality of D. 

Now let the c common squares, from left to right, be D* m . for 1 < j < c. 
We group the other squares of S according to their rows. Let do be the number 
of these other squares that are north of D* ni . Let d s be the number of the other 
squares that are south of D^ ris and north of for 1 < s < c — 1. Finally 

let d c be the number of the other squares that are south of D* n 

Note that all the squares counted by d c must be to the right of D mc , so we 
must have d c < k — m c because if there were k — m c + 1 squares Bi counted 
by d c then the sequence D\ . . . D mc -i followed by the BiS would contradict the 
minimality of D. Next, we must have d s < TO s +i — m s — 1. To see this note 
that the squares counted by d s must be west of the column containing Z?* i(s+i) 
and east of the column containing D* m . Therefore if there were m s+ i — m s 
squares Bi counted by d s the sequence DiD 2 ■ ■ ■ D TOs _i, followed by the B^s 
and then D ms+1 . . . Dk would contradict the minimality of D. Finally, observe 
that do < mi — 2. For if there were mi — 1 squares counted by do then these 
BiS followed by D mi . . . Dk would contradict the minimality of D. 

Now when c > 1 we have 

k = c + d 

c-1 

= c + dp + d c + 2J 

s=l 

c-1 

< c + (mi — 2) + (fc — m c ) + m s +i — Tn s — 1 

s=l 

< (c — 1) + (k — 1) + mi — m c + m c — m,\ — (c — 1) 
= fc - 1. 

When c = 1 we obtain the similar contradiction 

k=l + d + d 1 <l + (mi - 2) + (fc - mi) = fc - 1. 
Therefore 4>(P)r cannot contain a fc . . . 1-pattern in R, as claimed. □ 

4. Pivots 

In this section we introduce the left and right pivots of rook placement on a 
rectangular Ferrers board, and show how they relate to the Robinson-Schcnstcd 
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correspondence and to cf>* . While the right pivots have nicer properties in con- 
nection with the RS correspondence, the left pivots have nicer properties with 
respect to x 



Definitions. Let P be a placement on rectangular Ferrers board F. We define 
the set of left pivots of P (respectively, right pivots of P) to be the placement 
piv; P (respectively, piv r P) defined by inductively placing markers, row by 
row, from bottom to top, as follows. 

First, there is no pivot in the bottom row. Now consider row r > 1. If there 
is no element of P in row r then we do not place a pivot in row r. Now suppose 
X G P is in row r. If there is a column to the left (respectively, right) of X 
that contains an element of P below row r but does not contain a pivot then we 
place a pivot in row r and in the rightmost (respectively, leftmost) such column. 

Notation. For a placement P on a rectangular Ferrers board F define rev(P) 
to be the placement obtained by reflecting F and P along a vertical line. 

Below is an example of left and right pivots of a placement. 
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Figure 1: On the left we have P and piv z (P). On the right we have rev(P) and 
piv r (P). In both examples elements of P are denoted by x and the pivots are 
denoted by •. 



Looking at Figure 1 we see the following relationship between left and right 
pivots. Its proof is straightforward. 

Lemma 4. For any placement P on a rectangular Ferrers board F we have 

rev^piv; P^j = piv,. ^rev P^j . 

The utility of pivots is due to their connection with the Robinson-Schensted 
(RS) algorithm. We will consider applying the RS algorithm to a placement 
P. What we really mean is that we are implicitly applying it to the partial 
permutation corresponding to P. We will also write ins(P) and rec(P) for the 
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insertion and recording tableaux of P. Let us first compare the insertion and 
recording tableaux for P, piv r (P), and piv ; (P) using the placement on the right 
hand side in Figure 1. 

When we apply RS to P we get 





1 


4 


jy 


1 


3 


9 


ins P = 


2 


5 


rec P = 


4 


8 






7 






6 








9 






7 







Now on the one hand RS applied to piv r P gives us 



2 


5| 


7 




9 





ins(piv r P) 

while RS applied to piv z P gives 
ins(piv, P) 



rec(piv r P) 



rec(piv z P) = 



4 


8| 


G 




7 





1 


8 


j_ 





We see here that the RS algorithm applied to piv r P gives the same insertion 
and recording tableaux, minus the top row, as the RS algorithm applied to P. 
And the insertion tableau of piv ; P is equal to ins P, minus its left column. 
This is the content of the next two theorems. 

Notation. If Y is a standard Young tableau then we will denote by Y~ the 
tableau consisting of all but the top row of Y and ~Y the tableau consisting of 
all but the left column of Y. 



Theorem 1. Let P be a placement on a rectangular Ferrers board. Then we 
have 

ins(piv r P) = (ins P)~ and rec(piv r P) = (rec P) _ 



Proof. Let 



n 12 

S\ s 2 



with i\ < i% < . . ., be the partial permutation corresponding to P. Let 



Pi P2 

Vl v 2 



with pi < p2 < ■ ■ ., be the partial permutation corresponding to piv r (P). 

If we consider the RS algorithm applied to it it will suffice to show that 
inserting Tr{pj) into the insertion tableau causes Vj to be bumped from the first 
row and that the Vj are the only numbers bumped from the first row. To show 
this we use induction on m, the number of pivots. If m = then 7r must have 
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no 21-pattcrn and hence si < S2 < Hence (ins 7r)~ = and (rec ir)~ = 0. 

Now assume 7r is such that m > 0. Define /c so that = p m and consider 7r|fc_i, 
the restriction of -k to its first k — 1 entries. Then we have 



By induction the RS algorithm applied to 7r| 1 bumps Vj on the pjth move 
for 1 < j < m — 1 and bumps nothing else. So the top row of the insertion 
tableau is just 



Since applying the RS algorithm to 7r|fe_i is the same as partially computing 
the RS algorithm on n up through the index ik-i of tt we may assume this is 
where we are in the algorithm. We now claim that inserting the next value of 
7T, Sfe, into the insertion tableau bumps v m from the first row of the insertion 
tableau. Showing this is equivalent to showing that v m € S and that v m is the 
smallest element in S that is greater than s^. Clearly v m € S as all the Vj 
are distinct. Now if s 6 {sj | 1 < j < k — 1} and < s < v m then ssk is a 
21-pattern. But this implies that for some i < m, s = Vi. Hence s ^ S and v m 
is indeed bumped by the insertion of Sk ■ Therefore after the fcth move the first 
row of the insertion tableau is 



Now let k < j < n. To complete the proof we need only show that the RS 
algorithm appends Sj to the top row of the insertion tableau. This is equivalent 
to showing that Sk+i < Sfc+2 < • • • and that Sk+i is greater than all the elements 
in S' . If the Sj are not increasing from j = k + 1 onward then they must 
contain a 21-pattern and hence there exists a pivot to the right of position p m , 
contradicting our choice of p m . If Sk+i is not greater than all the elements in 
S' then for some s' € S', s's^+i a 21-pattern. This means that either s' = V{, 
for some i, or ik+i = Pj, for some j. But this contradicts either our definition 
of 5" or our definition of p m . □ 

Remark 1. We thank Scrgi Elizaldc for suggesting to us that there might be 
a connection between our right pivots and Viennot's geometric construction. 
It turns out that the right pivots coincide with Viennot's "northeast corners". 
This follows from the fact that Vicnnot establishes the analogue of Theorem Q] 
for the northest corners. 

To state our theorem relating left-pivots and the RS algorithm we first need 
the following. 

Notation. If Y is any standard Young tableau then denote by Y tr the trans- 
posed tableau, i.e., the tableau obtained by reflecting Y across the NW-SE 
diagonal. 




S 



{sj I 1 < j < k - 1} \ {vj I 1 < j < m - 1}. 



S' = {sj I 1 < j < k} \ { Vj \ l<j< m}. 
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Likewise, if P is any placement on a rectangular Ferrers board F then denote 
by F tr and P tr the resulting board and placement obtained by reflecting F and 
P across the NW-SE diagonal. 

Remark 2. Recall the well known fact that for any placement P we have 

ins (rev P) = (ins P) tr . 
For a proof of this result see [7] , page 97. 

Theorem 2. Let P be a placement on a rectangular Ferrers board F. Then 

ins(piv ; P) = (ins P). 

Proof. By Lemma 5] we have 

rev(piv ; P) = piv,,(rev P). 

Taking the insertion tableau of both sides and applying Theorem Q] to the right 
hand side we get 

ins I rev (piv; P) J = [ins I rev PI] - . 



Then by Remark 2 we have 

(ins (piv ; P)f = [(ins P) 4 T. 
By then transposing both sides we have 

ins(piv, P) = ([(ins P) tr }~) tr = -{ins P). 

□ 

Definitions. Let P be a placement on a rectangular Ferrers board. For any 
X € P, if X is in the same column as some V G piv z P then define p(P, X) = 
mw(V) else define p(P,X) = oo. 

Likewise, if X is in the same row as some V € piv z P then define k(P,X) = 
col(V) else define k{P,X) = 0. 

If the placement is understood we will just write p(X) or k(X). 

Next let us establish some symmetry intrinsic to left-pivots 

Lemma 5. If P is a placement on a rectangular Ferrers board F with n columns, 
then we have 

(piv, P)^ = piv ( (P tr ) 

Proof. Observe that this is equivalent to showing that the set piv ; (P) may be 
constructed by the following column construction. 

Column Construction 
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First, there is no pivot in the rightmost column. Now consider column c < n. 
If there is no element of P in column c then we do not place a pivot in column 
c. If X £ P is in column c then if there is a row above X that contains no pivot 
to the right of column c but does contain an element of P to the right of column 
c then there is a pivot in column c and in the lowest such such row. 

For reference we will call these pivots column pivots. To show that the 
column and row constructions agree assume inductively that 

column pivots(P) = piv ; (P), for all columns to the right of c. (1) 

Assume for a contradiction that the column pivots and left pivots disagree 
in column c. Note that if there is no column pivot in column c then by ([TJ we 
cannot have a left pivot either. Now assume we have a column pivot in (c, r), 
for some r. So there must exist X, Y 6 P with co\{X) = c, row(F) = r and 
XY a 12-pattern. If there is no left pivot in (c, r) then it follows from (p} that 
k(Y) < c. But this can only occur if there exists some Z G P with row(Z) < r 
and k(Z) = c. But then (flj and the column construction imply that the column 
pivot in column c would be in some row < r and not in row r as assumed. □ 

The following definition and lemmas will be useful in Sections 5 and 6. 

Convention. Since we will only be working with left pivots for the remainder 
of this paper, the term pivot will mean left pivot from now on. 

Definition. We say an increasing subsequence I of P is a pivot-path, if for all 
i < |J|, p{Ii) = row(ii+i), i.e., each consecutive pair creates a pivot. 
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Figure 2: An example of pivot-paths where the placement is denoted by x and 
the pivots are denoted by •. The consecutive elements of each pivot path are 
connected by red lines. 
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Lemma 6. If X, Y £ P arc such that XY is a 12-pattern then we cannot have 
row(y) < p(X) and k(Y) < col{X). 

Proof. If both of these held, then according to the construction of pivots we 
would have co\(X) < n(Y). □ 

Lemma 7. Let X, Y, Z G P be such that XYZ is a 132-pattern. If there is 
a pivot-path / with first element X and last element Y then there exists a 
pivot-path J with last element Z such that X J\ is a 21-pattern. 

Proof. Let K be the longest pivot-path with last element Z . Note that KP\I = 0, 
for if not then K U / is a pivot-path but this is prohibited as XYZ is a 132- 
pattern. Observe that I and K cannot "cross", i.e., for all 12-patterns I%Kj, we 
cannot have row(Kj) < p(Ii) and n{Kj) < col(A) by Lemma [6j Therefore, if 
XK\ is a 12-pattern then for some i, hK\ is a 12-pattern with row(A'i) < p(h). 
But by the maximality of the length of K we must have n(Ki) = < col(A). 
But this cannot happen by Lemma [6] Therefore, if K\ is to the right of X we 
can take J = K. If K\ is to the left of X, define Ki to be the first element of 
K that is to the right of X. Observe that Ki must be below X since J and / 
do not cross. Take J = KiKi + i . . . Z . □ 

The statement of the next lemma is similar to Lemma [7] Its proof is also 
similar to that of Lemma [71 but simpler. 

Lemma 8. Let X, Y £ P such that XY is a 12-pattern. If row(F) < p(X) then 
there exists a pivot-path J, with last element Y, such that X J\ is a 21-pattcrn. 

Lemma 9. Let S be a decreasing sequence of length k in P. Assume there is 
some X G P such that XS\ is a 12-pattern. If p(X) > row(Si) there exists a 
decreasing sequence D of length k + 1 with D\ = X, and if X and Si are the 
first and last elements of a pivot-path then there exists a decreasing sequence 
D of length k with D X =X. 

Proof. First consider the case when X and S\ are connected by a pivot-path. 
We will proceed by induction on k, the length of S. If k = 1 then we may 
take D — X. Now consider > 1. If row(A) > row(S , 2) then we may take 
D = XS2 ■ ■ ■ Sk- If on the other hand row(X) < row(S , 2) then Lemma [7] implies 
that there exists a pivot-path J with last element 5*2 and X J\ a 21-pattern. Now 
by the induction hypothesis applied to J± and the shorter sequence S2S3 . . . 
we have a decreasing sequence E of length k — 1 with E\ = J\. But then the 
decreasing sequence D = XE1E2 ■ ■ ■ Ek-i is what we want. 

For the case when p(X) > row(Si) first apply Lemma [5] to the 12-pattern 
XSi to obtain a pivot-path J such than X J\ forms a 21-pattern and J's last 
element is S\. Now apply the first case to J\ and the sequence S to obtain 
a decreasing sequence E of length k with E\ = J\. Then we may take D = 
X Ex E 2 .. .E k which is of length k + 1. □ 

Note that the previous lemma and Lemma [5] directly imply the following 
result. 
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Lemma 10. Let S be a decreasing sequence of length k in P. Assume there is 
some X € P such that S\X is a 12-pattern. If k(X) < col(Si) then there exists 
a decreasing sequence D of length k + 1 with D\= X, 



5. The Proof of the Main Lemma 

The purpose of this section is to prove the Main Lemma which is the crucial 
piece needed to show that our growth diagram construction corresponds to the 
map 0*. Note that up through Lemma [11] F will always denote a rectangular 
Ferrers board and P a rook placement on F. 

Wc begin with some notation and definitions. 

Notation. Define P| a ,b to be the Ferrers board consisting of all columns of F 
between and including columns a and b, and define P\ a ,b to be the restriction 
of PtoF| a , 6 . 

Definitions. Fix a subplacement S, let k ~ \S\, and order S such that S — 
Si ... Sk where col(Si) < col(Sj+i). Further fix a column c and assume that P 
has no element in column c. 

We first define a left-shift. Assume S lies entirely to the right of column 
c. Place markers in all the squares of P, and then shift each marker in square 
Si for 1 < i < k horizontally left to column col(£i_i) and shift the marker in 
Si horizontally left to column c. Define P(c <— S) to be the squares that now 
contain markers. Likewise, define c <— S to be P(S 4— c)\P, the placement 
obtained from S by shifting it left. 

Analogously, we define a right-shift. Assume S lies entirely to the left of 
column c. Place markers in all the squares of P, and then shift each marker 
in square Si for 1 < i < k horizontally right to column col(Si+i) and shift the 
marker in Sk horizontally right to column c. Define P(S — > c) to be the squares 
that now contain markers. Likewise, define S — > c to be P(S — > c) \ P, the 
placement obtained from S by shifting it right. 

Definitions. Let P be a placement on a rectangular Ferrers board F. Let a < b 
be columns of F. 

Let k be the length of the longest decreasing sequence in P\ a ,b- Define 
da,b(P) (respectively, T) a ,b{P)) to be the smallest (respectively, largest) de- 
creasing sequence, under the lexicographical ordering, in P\ a ,b of length k. 

Likewise, let m be the length of the longest increasing sequence in P| a ,&. 
Define i a ,b{P) (respectively, I Q) t,(P)) to be the smallest (respectively, largest) 
increasing sequence, under the lexicographical ordering, in P\ a ,b of length m. 

We are now ready to state and prove Lemma QT] Although Lemma QT] is the 
key driver behind the Main Lemma, its statement is more general then what 
is needed to prove the Main Lemma. The reason for this is that the precise 
statement of Lemma [TT1 is exactly what is needed in Section 6. 
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Lemma 11. Let P be a placement on a rectangular Ferrers board F and assume 
P has no marker in column a. Let S = d a ^(P) and P* = P(a «— S). Then we 
have 

ins(P) = ins(P*). 

Proof. First let S* = a <— S, i.e., the shifted sequence, and k = \S\. Define b' to 
be the column containing Sk and consider the truncated board and placements 
G = F\i,b>, Q = P\i,b' and Q* = P*\i,b'- Now in order to show 

ins(P) = ins(P*), 

it will suffice to show 

ins(Q) = ins(Q*). (2) 

To see this consider the GDA applied to P and P* on the full board F. By [11], 
Theorem 7.13.5, knowing ([2]) is the same as knowing that the partitions along 
the line x = b' in the GDA of P and in the GDA of P* are identical. But the 
placements P and P* are identical east of the line x = V . Therefore if ([2]) holds 
we know that the partitions along the right border of F in the GDA of P and 
in the GDA of P* are also identical. By [11], Theorem 7.13.5, this implies that 

ins(P) = ins(P*). 

In order to show (|2|) it is sufficient to prove 

piv, Q = piv, Q*. (3) 

To see why note that along with Theorem [5] implies that 

"[ins(Q)] = ~[ins(Q*)] 

But this forces ins(Q) = ins(Q*) as needed. 

To establish (j3|) we will proceed inductively by assuming that the pivots (if 
any) below some row r are unchanged and then showing that the pivot (if any) 
on row r is unchanged. To do so we consider two cases. 

Case 1 : Row r contains an element Si of 5*. 

Let R be the rectangular region of F containing all squares west of col Si 
and south of row Si. By the nature of a left-shift, Q\r = Q*\r. Further, by our 
induction hypothesis piv ; (<5|^) = piv ; (<3*|#). It then follows that the only way 
the pivot (if any) on row r could change is if piv ; (Q) contains a pivot in row r 
between columns a' and col(S'j), where a' = a, if i = 1, and a' = col(Si_i), if 
i > 1. 

To show this is impossible assume, for a contradiction, that piv ; (Q) does 
contain a pivot in row r between columns a' and col(j5i). Then there must exist 
some X 6 Q that is directly below this pivot. Since XSi is a pivot-path, Lemma 
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[51 applied to X and SiSi+i . . ., implies the existence of a decreasing sequence 
D of length k — i + 1 with first element X. But this is a contradiction since the 
decreasing sequence Si . . . Si-\D is smaller than S 1 . 

Case 2 : Row r contains X £ Q \ S. 

By the maximality of the length of S, Si-iXSi cannot be a 321-pattern for 
any i. Therefore it will suffice to assume that SiX is a 12-pattern for some i and 
that i is chosen as small as possible. Then col(S'j) < k(X, Q). If not then Lemma 
[TU]would give rise to sequence of length k+l contradicting the maximality of the 
length of S. Therefore we must have an element Y S Q with col(Si) < col(y) = 
k(X, Q). Since col(Sj) < col(Y) < V then column col(y) must contain an 
element of Q* below row r. (Note that for the case where Y <G S, Y cannot 
be the last element of S.) This plus the induction hypothesis implies that 
col(y) < k(X,Q*). Assume now, for a contradiction, that col(Y) < k(X,Q*) 
and let Z 6 Q* be such that col(F) < col(Z) = k(X,Q*). Now, by similar 
reasoning, col(Z) must contain an element of Q below row r. But this plus the 
induction hypothesis implies that k(X,Q) = col(F) < col(Z) < k(X,Q), an 
obvious contradiction. □ 

To prove the Main Lemma it suffices, by [11], Theorem 7.13.5, to prove the 
following. 

Lemma 12. Let P be a placement on a not necessarily rectangular Ferrers 
board. Let S be the smallest k . . . 1-pattern in P and let b = row(Si) and 
a = col(Sfc). If i?i = R{a, b - 1) then 

ins(PU 1 )=ins(^(P)U 1 ). (4) 

Likewise, if R-2 = R(a — 1, b) then 

rec(PU 2 ) = rec(<KP)k). (5) 

Proof. Let Q = P\ Rl and T = cf>(P)\ Rl . Observe that S 2 ,...,S k = d col(Sl))0 (Q). 
Now Lemma [TT] implies Q . 

For (J5J let R = R(a,b) and Q = P\ R and T = <f>{P)\ R . Observe that 
T' = 4>{Q'), where Q' and T 1 are the inverses of Q and T in the sense of Section 
2. This follows from the fact that S is the decreasing sequence of maximal length 
in R, which implies that S is also the position smallest sequence of length k in 
R (i.e., S is the smallest if we order k . . . 1-patterns lexicographically according 
to the positions of the entries, rather than the values of the entries), so that S' 
is the value smallest decreasing sequence of length k in R' . 
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Figure 3: On the left we have an example of Q and T. On the right we have Q' 
and T". In both pictures the 4>(S) is marked by the red x's. 



Applying (@|, we know that 

ins(Q / |^)=ins(T'|^). 
So by the theorem of Schutzcnbcrgcr mentioned in Subsection 2.1 we have 

rec(Q| R2 ) = rec(T|R 2 ). 
This completes the proof. □ 



6. Generalized Knuth Transformations 

Recall (see, for example, [11], page 414) that a Knuth transformation of a 
permutation a interchanges two adjacent elements x and z of a provided that 
there exists a third element y, which is adjacent to cither x or z, such that 
x < y < z. Two permutations a and p are called Knuth- equivalent, written 
a ~if p, if p may be obtained from a by a sequence of Knuth transformations. 

It is a well known result that two permutations are Knuth-equivalent if and 
only if they share the same insertion tableau. For a proof of this result see, for 
example, [11], page 414. 

Fix a placement P on a rectangular Ferrers board F. Further fix columns 
a < b in F. Let d = d a>b (P), D = D , 6 (P), i = i a , b (P), and I - I a , 6 (P). 

Definition. Transforming the placement P into either of 

P(a <- d) or P(a <- I) 
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if P has no placement in column a, or to either of 

P(D -> b) or P(i 6) 

if P has no placement in column 6, is called a generalized Knuth transformation. 

The next theorem, which is the main point of this section, shows that any two 
placements that differ by these generalized Knuth transformations are actually 
Knuth-equivalcnt . 

Theorem 3. If two placements P and Q differ by generalized Knuth transfor- 
mations then ins(P) = ins(Q). 

Before launching into the proof of this theorem let us pause to see how these 
four new transformations are generalizations of the standard Knuth transfor- 
mations. First consider the Knuth transformation 



53476281^5347621 



Note that this is of the form yzx i— > yxz. Now consider P a to be the placement 
corresponding to a on a 9 x 8 rectangular board where we have an empty 
column between the '6' and the '2'. Observe that d6 ; g(P CT ) corresponds to the 
subsequence 21 in a and that the partial permutation associated to 

P CT (6 «- defiiP*)) 

is order-isomorphic to p. It follows that any Knuth transformation of the form 
yzx I— > yxz is generalized by the transformation P t-> P(a <— d). Similar 
reasoning demonstrates how the remaining 3 standard Knuth transformations 
correspond by the remaining 3 generalized Knuth transformations. For com- 
pleteness we give the correspondence in the table below. 

Generalized Standard 

P M> P(a d) • • • yzx yxz ■ ■ ■ 

P M> P(D — > b) ■ ■ ■ yxz • • ■ i — y ■ ■ • yzx ■ ■ ■ 

P M> P(i — > b) ■ ■ ■ xzy • • ■ i — y ■ ■ • zxy ■ ■ ■ 

P M> P(a <— 1) ■ ■ ■ zxy xzy ■ ■ ■ 

Observe that the standard Knuth transformations are clearly reversible. For 
example yzx t— > yxz and yxz t— > yzx are obviously inverses. This nice property 
of the standard transformations extends to the generalized transformations. We 
will see below in Lemma [T5l that transformations of the forms P(a <!— d) and 
P(D — > b) are inverses and it follows by considering the reverse of a placement 
that transformations of the forms P(i — > b) and P(a ^— I) are inverses. 

It remains to prove Theorem [3l This will occupy the remainder of this 
section. We start with a simple definition. 
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Definition. If S is a decreasing sequence in P then we say that a subplaccmcnt 
A C P is a&oue S if for every C G A there exists some index i such that 5jC is 
a 12-pattcrn. Likewise, we say that B C P is 6eZoio 5 if for every C € B there 
exists some i such that CSi is a 12-pattcrn. 

Lemma 13. Let L be a longest decreasing sequence in P\ a ,b, of length fc. If 
L^D = D 0) &(P) then P{L — »• 6)| a ,6 contains a decreasing sequence of length 
fc + 1. If L 7^ d then P(a <— £)|a,6 contains a decreasing sequence of length 
k + 1. 

Proof. We prove only the first assertion. The second is analogous. 

As L ^ D we must have some sequence D in P| Q) b with \D\ = k that is 
value- larger than L. For D to be value-larger than L we must have some < I 
and some I + 1 < m such that 

D = L\ . . . LiD[ + i . . . D m D m+ i . . . Dk 

where .Dj+i . . . D m is above L and D m+ i is not above L, or D m is the last 
element of D. Now define n to be the index such that D m is between the 
columns containing L n and L n+ i, or n = fc if D m is the last element of D. 

Clearly L* rn +i ^ L rl and as I? m +i is not above L then L n D m +i must be a 
21-pattern. Therefore 

L\ . . . L n D m+ i . . . Dk 

is a decreasing sequence in P\ a ,b- Since no decreasing sequence in P\ a ,b has 
length greater than k then we must have n + k — m < k, i.e., n < m. Further, 
observe that 

D\ . . . D m L n+ i . . . Lk 

is also a decreasing sequence in P\ a .b- By similar logic we must have m < n. 
Therefore m = n. 

Now consider the right-shift and let L* = L — > b. Finally, observe that 

L* . . . L\Di +1 . . . D m L* n ...LI 

is a decreasing sequence in P(L — » £>) [«.,&- Since m = n its length is fc + 1 as 
claimed. □ 

Lemma 14. We have the following relationships for decreasing sequences: 



a <— d is longest 
D — > b is longest 

Proof. First let Q = P\ a .b and define n 
Q. Now define 

Qi = Q(l <- di, n (Q)) 



in P(a <- d)| 0)6 
in P(D — »■ 6)U, 6 

= b — a + 1, the number of columns in 
Q 2 = Q(D!,„(Q) -)■ n). 
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It will suffice, by the result of Schensted mentioned in Subsection 2.1, to prove 
that 

shape(Qi) = shapc(Q). 
For the first assertion, shape(Qi) = shapc(Q) follows directly from Lemma 

ED 

For the second assertion let Q* and Q2 be the complements of the reverses 
of Q and Q2- (By the complement of Q we mean the placement obtained by 
flipping Q and P| a ,b about a horizontal line.) Note that 

Q5 = Q*(l«-d lin (Q*)). 

From the first assertion we know that shape^Jj) = shape(Q*). Therefore 
shape(Q 2 ) = shape(<3). □ 

The next lemma will enable us to reverse generalized Knuth transformations. 
We state the results explicitly only for decreasing sequences. As remarked pre- 
viously the results for increasing sequences follow immediately. 

Lemma 15. Let k = |d| and assume that is in column b. Then we have 

a^d = D a , 6 (P(a <- d)). 
Likewise, if Di is in column a, then we have 

D -^& = d a , b (P(D ->.&)). 

Proof. For the first claim set P* = P(a <!— d). Assume for a contradiction that 
o<-d/ D 0j &(P*). By Lemma [TH we know that a <- d is a longest sequence 
in P(a <— d)| a 5. Now Lemma fl3l implies that P*((a <— d) — > 6)| a ,6 = P\a,b has 
a decreasing subsequence of length k + 1. But this is impossible since |d| = k. 

A similar argument may be used to obtain the second claim. The details are 
straightforward. □ 

Proof of Theorem It will suffice to prove that the insertion tableau of a place- 
ment is invariant under any of the four generalized Knuth transformations. We 
give the arguments for decreasing sequences only. 

Case 1 : P(a <- d). 

This is clear bvlTTl 

Case 2: P(D -> b). 

First define a' to be the column containing the first element of D . Lemma 
ED implies that D -> b = d a ^[P(D ->■ b)}. Letting P* = P(D -> 6), Case 1 
gives 



ins P* = ins[P*(a' ^— (D — > 6))] = ins P. 



□ 
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